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[57] ABSTRACT 

A method and system for generating accurate search results 
using a content-index is provided. In a preferred 
embodiment, a content-index search system is invoked in 
response to a query on a collection of objects. The collection 
of objects is indexed by the content-index and may, for 
example, be a corpus of documents indexed by the terms 
contained in the documents. The content-index search sys- 
tem uses the content-index to generate and store an initial 
search result in response to the query. Because the content- 
index is typically out of date with respect to a dynamically 
changing collection of objects, me content-index search 
system invokes search result correction routines to remove 
from the stored search result references that were incorrectly 
included and to add to the stored search result references that 
were incorrectly excluded. References that were incorrectly 
included include those that refer to objects mat no longer 
exist and those that refer to objects that have been modified 
since the content-index was last updated and that no longer 
match the search criteria. References that were incorrectly 
excluded include those that refer to new objects that were 
not indexed and match the search criteria and those that refer 
to objects that have been modified since the content-index 
was last updated and that now match the search criteria. 

60 Claims, 13 Drawing Sheets 
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METHOD AND SYSTEM FOR GENERATING 
ACCURATE SEARCH RESULTS USING A 
CONTENT-INDEX 

TECHNICAL FIELD 

This invention relates generally to a computer method and 
system for generating accurate search results, and, more 
specifically, to a computer method and system for generating 
accurate search results using a content-index that is not kept 
up to date in real time. 

BACKGROUND OF THE INVENTION 

Existing computer systems provide the capability to 
search a collection of documents to identify those docu- 
ments that contain a certain word, or phrase, or a combina- 
tion of words. For example, given a collection of documents, 
the computer system can return a list of the documents that 
contain the word '^patent* or can return a list of the docu- 
ments that contain the phrase "patent application." In 
addition, the computer system can return a list of the 
documents that either contain the word "patent" or contain 
the word "application." This list includes those documents 
that only contain the word "patent," those that only contain 
the word "application/ and those that contain both words. 

Such computer systems also provide the ability to effi- 
ciently find or retrieve documents in response to such 
queries by indexing the contents of the documents. Indexing 
information is typically stored in a structure referred to as a 
content-index. A content-index typically indexes multiple 
documents and includes indexing data (eg., keywords) and 
reference data that refers to the documents that contain the 
indexing data. For example, a typical content-index may 
store as the indexing data each major term contained in each 
document Each term is stored as a separate entry in the 
content-index and each entry contains a reference to the 
documents that contain that term. Thus, a content-index can 
be used to determine which documents contain a particular 
term. 

A content-index is typically stored in an efficient data 
structure, such as a hash table or B-tree, so that information 
can be retrieved efficiently in response to queries. A typical 
content-index can be used to answer simple queries involv- 
ing the use of an indexed term verbatim, as a prefix, or as 
queries involving the use of an indexed term verbatim, as a 
prefix, or as specifying a range. For example, if the indexed 
term is the word "second" then the content-index can be 
used to find all documents mat contain the word "second." 
Also, the content-index can be used to find all documents 
containing the word "second" as a prefix. For example, a 
document containing the word "secondary" would satisfy 
(match) the query. Also, for example, if the indexed term is 
a range, for example, "second-fourth," then a document 
containing the word "third" would satisfy the query. Such 
queries involve a simple lookup of the term in the content- 
index and the retrieval of the set of documents that contain 
the indexed term or a term within the specified range. 

TVpically. generating or updating a content-index for a 
collection (oftentimes referred to as a corpus) of documents 
is a slow process. Each document is read and parsed into the 
terms that will be used as indexing data and then the 
appropriate entries are generated in the data structures of the 
content-index. For large documents or a large number of 
documents this process is very time-consuming. Also, it is 
difficult to keep a content-index up to date when the corpus 
of documents is continuously changing. In such scenarios, 
the content-index is typically not kept up to date. Instead, 



existing systems typically either (1) update the content- 
index in response to an explicit command by the user, (2) 
update the content-index at some predetermined interval, 
e.g. every night, or (3) update the content-index each time a 
query program receives a query. More specifically, in the 
third case, when the query program receives a query regard- 
ing the content of the corpus of documents, the query 
program first updates the content-index and then executes 
the query. For many scenarios, the update procedure of the 
third case is too slow to be useful. 

SUMMARY OF THE INVENTION 

The limitations of prior methods and systems are over- 
come by the present invention, which is an improved method 
and system for generating accurate search results using a 
content-index. In a preferred environment a content-index 
that indexes a collection of objects is generated and stored 
in a computer system. In response to a query, an initial 
search result is generated using the content-index and stored 
The stored search result contains references to objects in the 
collection that match a search criteria specified in the query. 
Once the search result is initially generated using the 
content-index, the method and system improves the accu- 
racy of the stored search result by removing references to 
objects that should not have been included. Le., false posi- 
tive results, and by adding references to objects mat should 
have been included, Le., false negative results. False positive 
results include references to objects that no longer exist in 
the collection of objects and references to objects that no 
longer match the search criteria. False negative results 
include references to objects mat are new to the collection of 
objects and match the search criteria. False negative results 
also include references to objects that have been modified 
since they were last indexed in the content-index and now 
match the search criteria. 

In another embodiment, the objects in the collection are 
documents. 

In yet another embodiment, the collection of objects is 
only partially indexed by the content-index and the initial 
search result is generated using both the content-index and 
the remaining objects in the collection. 

In yet another emtodiment, the collection of objects is 
indexed by multiple content-indices. These multiple 
content-indices are used in the removal of false positive 
results and in the addition of false negative results. 

In yet another embodiment, a timestamp is stored as part 
of the content-index to facilitate the determination of modi- 
fied objects. 

In yet another embodiment, a system is provided with 
30 components that include: object list sorters; an object list 
comparator that generates a list of new or modified objects; 
an object reference subtracter that compares the output of 
the object list comparator and the sorted search result to 
generate a list of new or modified objects that have not yet 
been added to the search result; an object direct search 
engine that directly searches each object referred to by the 
output of the object reference subtracter to generate a list of 
new or modified objects that match the search criteria; and 
a search result adder that receives output from the object 
direct search engine and adds to the search result references 
to objects that match the search criteria. In another 
embodiment, some of these system components work 
together in a pipelined architecture fashion, processing a 
single reference to an object at a time. 

In yet another embc<liment, a similar system of compo- 
nents is used to add false negative results to the stored search 
result 
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BRIEF DESCRIPTION OF THE DRAWINGS positive results, a search result correction routine removes 

references to objects that no longer exist in the collection 

FIG. 1 is an overview block diagram of the process used ^ references to objects that have been modified 

to generate an accurate search result. sulce they were last indexed by the content-index and no 

FIG. 2 is an example diagram of a File Open dialog that 5 longer match the search criteria. Similarly, to add false 

incorporates the methods and systems of the present inven- negative results, a search result correction routine adds 

tion. references to objects that have been added to the collection 

FIG. 3 illustrates a typical implementation of a content- and match the search criteria but have not yet been indexed 

index for a collection of documents. in the content-index and adds references to objects that have 

FIG. 4 is a block diagram of a general purpose computer 10 been modified since the content-index was last updated and 

for practicing preferred embodiments of the present inven- now match the search criteria. In this manner, the search 

^ 0Q result generated in response to a user query is made accurate 

HO. 5 is an overview flow diagram of the content-index e ™ £ ' ~ n * to geMratC ** ^ 
search code of the present tovention. search result U not up to date. 

HG. 6 is a flow diagram of a search result correction 15 f» one embodiment, references to ob^ Aat no long« 
. " . «^ exist are determined by examining the list of objects referred 

routine for removing false positive results. e ™ mc ^ M ^dlZi3i whcthcr eachobject still 

FIG. 7 is a flow diagram of the search result correction ^ tfae coupon 0 f objects. Also, references to objects 

routine for adding false negative results. that no longer match the search criteria are determined by 

FIG. 8 is a flow diagram of a routine that generates a list 20 examining each reference in the search result and detennin- 
of references to new or modified objects. lag whether tfae object referred to has been modified since 

FIG. 9 is a data flow diagram of a system embodiment for the time the object was last indexed in the content-index. For 
adding false negative results to a search result initially each such modified object, the object is examined to deter- 
generated by a content-index search engine. mine whether it still matches the search criteria. For the 

FIG 10 is a data flow diagram of a system embodiment 25 purposes of this invention, matching a search criteria and 
for removing false positive results from a search result satisfying a search criteria are synonomous expressions, 
initially generated by a content-index search engine. Similarly, references to new objects that match the search 

FIG U is a partial flow diagram of the modifications to criteria are a^termined by comparing the objects currently in 
the search correction routine for removing false positive w the collection with those objects indexed by the content- 
results when using partial content-indexing. 30 index to determine the objects that have been added to the 

FIG. 12 is a partial flow diagram of the modifications to collection since the c^tent-mto was last updated Each of 
Js^chresu^ction routinefor adding false negative *ese new objects is then 1 examined 1 to determine wheftertihe 
mc ^ TOUU , tuut ~7 6 obiect matches the search criteria. Also, references to objects 

results when uangpamalindemg^ Z ^^been modified since they were last indexed by the 

HO. 13 is a *™<^Z?^^Z?J^ * content-index and now match the search criteria are deter- 
content-mdex search code of FIG. 5 when used with a search comparing the time the object was last updated 

criteria that goes beyond a search solved exclusively using ^^^^ ZSm**** wiih thetime the object was 
a content-index. ^ mo ^ e< i according to the attributes of the object in the 

DETAILED DESCRIPTION OF THE collection. Each of the objects that has been modified since 

INVENTION 40 the time indicated in the content-index is then searched to 

determine whether it now matches the search criteria. 

The present invention provides methods and systems for diagram of the process used 

generating accurate search results using a content-index. "? accurate ^^alt. A query 101 is gen- 

According to tfae present invention, a user or a query ^^/^Tor by a user and sent as input to 
program generates a query regarding objects that ate « ^^dzx sZch system 182. For the purposes of this 
indexed by the content-^dcx. invention, the content-index search system ^preferably 

search system responsible for executing the query uses the content-index 103 based on a query and 

content-index to initially generate a ™s ^Ltes a search result 104. The search result, however, is 

generation of an initial search result is acampHshed using 8 accuratc ^ of ^ ia S , time the content-index 103 was 
well-known mechanisms, suchas searching me content- „ °^^hus as is typical when indexing a dynamic 
index for the indexing terms fpeafied by me search crtem ^ectio n £ objects> u^rch result 104rnay be Laccu- 
and relieving references to objects that contain those terms ^ method H nd systems of the present invention are 
as bxheated by the content-mdex. As teenbed in Jhe ^correction routines 105 to correct 

background section, where the collection of objects indexed ™ to generate » accurate search resutt 

by the content-index is dynamically changing, it is virtually sj 7~. 6 

impossible to keep the content-index up to date. Thus, the luo - . . 

initial search result generated and stored in response to the One skilled in the art will recognize that the content-index 
query has a high likelihood of being incorrect search system 102 may be an existing system and that the 

Once the initial search result is generated, the methods search result correction routines 105 correct *e results 
and systems of the present invention correct the stored 60 8«*rated by the existing ^sys^Alteramvery ttie content- 
Search result by removing from the search result references index search system 102 and toe search result ^correction 
Objects that should not have been included and by adding routines 105 may be part of the same unproved content- 
to the search result references to objects that should have index search system. Other variations are also possible, 
been included. References that should not have been The present invention also provides the ability to correct 
included are referred to as false positive results. References 63 a search result when the collection of objects is only partially 
that should have been included but were not included are indexed by the content-index. In such cases, a content-index 
referred to as false negative results. In order to remove false inclusion rule is provided for determining whether a given 
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object is indexed by the content-index. The portion of the D" shown in edit field 203. The search result that is 

collection of objects indexed by the content-index is referred displayed in the search result list box 202 is generated using 

to as the domain of the content-index. To accommodate the methods and systems of the present invention, 

partial indexing, the methods and systems used to generate Specifically, an initial result of the search is generated using 

an initial search result are modified to search the remaining 5 a content-index that indexes the files of the file system. This 

portion of the collection of objects not part of the domain in initial search result is then corrected using the methods 

addition to using the content-index. The search correction described in detail below to generate an accurate list of the 

addition and removal routines are then optimized to ignore files that match the search criteria specified in the search 

entries in the search result that were generated from the string edit field 203. 

remaining portion of the collection of objects. These entries 1Q Although the present invention is discussed specifically 

are ignored because they are known to be accurate. with reference to documents, one skilled in the art will 

The present invention also provides the ability to use appreciate that the present invention is useful in other 
multiple content-indices. That is, a collection of objects may contexts as well, such as with any object that may be indexed 
be indexed by more than one content-index. In this case, the for searching purposes. For example, a graphical object, 
methods and systems of the present invention examine the 15 such as an electrical drawing, that contains symbolic 
multiple content-indices as needed to efficiently determine information, such as bitmaps of transistors and NAND gates, 
what references to objects to add to or remove from the can be indexed in a content-index using graphical bitmaps, 
search results. For example, in order to determine whether a content-index search system for these graphical objects 
an object has been modified since it was last indexed by a determines matches by searching the object contents for the 
content-index, all of the content-indices are typically exam- ^ presence of the indexed graphical bitmap, for example, by 
ined to search for the last time the object was indexed by one searching for a pattern of bits. In a similar manner, any 
of the content-indices. Alternatively, if the indices are mutu- content-index that indexes a collection of objects is subject 
ally exclusive (that is, it is known that only one index to the methods and systems of the present invention as long 
indexes a particular object of a collection at a time), men the as a content-index search system is implemented, 
content-indices are searched only until one index is found ^ fig. 3 illustrates a typical implementation of a content- 
that contains the object in question. (Because this index index for a collection of documents. The documents shown 
contains a reference to the object, then by definition of being m FIG. 3 are those discussed with reference to FIG. 2. The 
mutually exclusive, the time indicated in that content-index content-index 301 is shown after it has been generated to 
represents the time the object was last indexed.) Moreover, index the "docl.txT document 321, the "doc2.txt" document 
optimizations made to the methods and systems to accom- 30 322, and the "docSjils" document 323, but before it has 
modate the use of multiple content-indices can be combined been updated to reflect the most recent contents of docu- 
with the optimizations made to accommodate a partially mc nts 321, 322, and 323. The content-index 301 comprises 
indexed collection of objects. an inverted list 302 and an object list 303. The inverted list 

For example, the methods and systems of the present 302 is arranged such that it efficiently stores the indexing 
invention can be embodied in a File Open dialog, such as 35 terms and the references to the documents that contain each 
mat provided by a word processing application, to open for term. In a typical implementation such as mat shown in FIG. 
editing a particular document (or set of documents) that 3, the inverted list 302 comprises a directory structure 304, 
match a specified search criteria. FIG. 2 is an example which contains the indexing terms, and leaf structures 
diagram of a File Open dialog that incorporates the methods 309-312, which contain the references to the indexed docu- 
and systems of the present invention. The File Open dialog 40 mcnts. The directory structure 304 stores the indexing terms 
window 201 contains search result list box 202, search string (or other indexing information) in a data structure that 
edit field 203, and various buttons, e.g., the "Find Now" allows efficient location of the desired term. For example, 
button 204 and the "Advanced Search" button 205. When a directory structure 304 is shown implemented as a B-tree, 
user wants to open a file that matches a certain search which contains three nodes: node 306, node 307, and node 
criteria, but does not remember the correct file name, the 45 308. The letters "A." "B, n **C, W and "D" represent the 
user can enter a text string in the search string edit field 203 indexing terms. The leaf structures 309-312 each contain 
and press the "Find Now" button 204 to instruct the word references to the documents that contain the indicated index- 
processing application to find all of the documents contain- ing term. 

ing the search string specified in edit field 203. Consider, for example, document 321 and document 323, 

The "Advanced Search" button 205, when depressed, 50 which both contain the term "A" Node 307 in the directory 

generates an additional dialog, which allows the user to structure 304 contains an entry for the indexing term "A." 

specify a more complex search criteria. Specifically, if the This entry points to leaf structure 309, which contains 

user wishes to specify a combination of text strings to search references to two documents labeled **r and **3." In the 

for, then the user uses the Advanced Search dialog to enter particular implementation shown, the leaf structures 

the text strings and the way in which the text strings should 55 309^312 point to a centralized list of documents for the 

be combined For example, the user could specify a search entire content-index (object list 303) to avoid storing large 

to find all documents containing the word "patent" or the or redundant amounts of information in the leaf structures 

word "application" or bom words (sometimes denoted as themselves. Thus, the references to a document li l" and a 

4 *patent OR application"). document "3" in the leaf structure 309 indicate which 

As shown in FIG. 2, the search result list box 202 60 documents in the object list 303 contain the indexing term, 

currently contains the names of the files that contain the text Specifically, leaf structure 309 indicates that the document 

string specified as the search criteria in edit field 203 after referred to by the first entry 315 in object list 303 contains 

the user has pressed the "Find Now" button 204. indexing term "A** and that the document referred to by the 

Specifically, the search result list box 202 contains the third entry 317 in object list 303 also contains the indexing 

names of three files, "c:\mydoc\johndoe\docl.txt,** 65 term "A." The object list 303 also contains additional 

"c:\mydoc\johndoe\doc2.txt," and information regarding each object (document) that is 

"c:\mydoc\janedoe\doc5.xls," which contain the string **C indexed by the inverted list 302. As shown, object list 303 
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contains in each entry the name of the object, flic location of In preferred embodiments, the methods and systems of 
the object, and a time stamp indicating the last time the the present invention are implemented on a computer system 
object was updated. By examining the referred to entries in comprising a central processing unit, a display, a memory, 
object list 303, the names and locations of the documents and input/output devices. Preferred embodiments are 
containing the indexing term "A" can be retrieved. Thus, the 5 designed to operate in an operating system environment 
first entry 315 refers to the document "dccl.txt" 321 and the such as the Microsoft Windows environment defined by 
third entry 317 refers to the document "oocSaIs " both of Microsoft Corporation in Redmond. Wash. One skilled in 
which contain the term "A." the art will recognize that embodiments of the present 

A content-index such as that discussed in conjunction invention can be practiced in other operating system envi- 
with FIG. 3 is used to generate the contents of the search 10 ronments. 

result list box 202 of the Hie Open dialog 201 in FIG. 2. FIG. 4 is a block diagram of a general purpose computer 
When the user presses the "Find Now" button 204, the code for practicing preferred embodiments of the present mven- 
rhat implements the File Open dialog invokes the content- don. The computer system 400 contains a central processing 
index search system, which uses the directory structure 304 unit (CPU) 401, a display screen (display) 403, input/output 
of the inverted list 302 to find the node(s) that correspond^) devices 404. and a computer memory (memory) 402. The 
to the one or more search criteria (search terms) specified in 15 search result correction routines and the code used to store 
edit field 203. When a term is located in the directory a content-index and (he initial search results preferably 
structure 304, the leaf structure associated with the corre- reside in the memory 402 and execute on at least one CPU 
spending n ode is examined to retrieve the references to the such as the CPU 401. The search result correction routines 
documents mat contain that indexing term. With respect to 412 are shown residing in the memory 402 along with other 
the example of FIG. 2. the content-index search system uses » programs 413, such as the content-index search system. A 
the content-index to find all of the documents that contain content-index, such as that described with reference to FIG. 
the term "C and the term "D." As seen in the inverted list 3, is shown as content-index 410 also residing in the 
302 the documents referred to by references " 1" and "4" memory 402 A search result, when generated in response to 
match this search criteria, and the documents "docl.txt" 321 a query, is shown also in the memory 402 as search results 
and "docl0.txt" are referred to by to entries 1 and 4 in the u store 411. The memory 402 is also shown containing the 
object list 303. Once the document references have been objects 406, 407, 408, and 409, which are Indexed by the 
retrieved, the content-index search system generates fully content-index 410. Alternatively, these objects and various 
qualified names (pathnames) of the documents by exaniining parts of toe context index 412 may reside on Wt/output 
me proper enuieTfrom object list 303 and then stores the device 404 such as P^ n <^<^™^ c£ 
wtrmames as an initial search result Thus, the initial search M the computer system 400 is shown as a single computer, one 
rwuTcontains the names "c:\my<toc\)ohndoe\docl.txt" and skilled in the art would appreciate that the present invention 
"wSedoe\docl0.txt" may be practiced on processing systems with varying 

N«e!however. that this initial search result is incorrect as architectures, including networked «vironr^t^U^ 
seentyatamining the illustrated contents of documents cesser envtronments and on sys f» 
321 322, and 323. Specifically, the document "docl0.txt" is 3J In one aspect of the invention, a preferred embodiment 
no longer part of to collection. Also, the documents provides a content-index search systtm (program, or code 
"docZtef 322 and "doc5 jOs" 323 have been modified since module) for carrying out the methods of the present inven- 
the content-index 301 was last updated and now match me tion. FIG. 5 is an overview flow diagram of fce conten - 
search crSeria because they bomWain the terms "C and index search code of tie present mventio* Thecontent- 
"D" (The terms that have been added to the modified <o index search code takes as input, a search criteria. The 
documents are bordered by dashed lines.) Thus, the search content-index search code generates*! ***** search result 
rwulTcorrection routines of the present invention are and then invokes routines to eon** the search result 
£voLWrect the initial search result. Specifically, the Specifically, in step 501 me content-index seardbc«te 
search result correction routines determine that the docu- generates an initial search result using the Vpropnate 
ment "c:\mydoc\ianedoe\docl0.txt- is no longer part of the 45 content-index or indices. As will be discussed forte betow. 
cXtion and remove the reference to this document from if the collection of objects is only rarrdally indexed, then 
teteZ search result In addition, the search result cor- generating me initial search result may involve examining 
rection routines determine that documents 322 and 323 have the objects themselves to determine whether the non- 
been modified since the time indicated by the tirnestamp indexed objects match the search criteria. In step 502, the 
contained in the content index entries 316 and 317, which jo code invokes a search result correction routine to remove 
correspond to these documents. Each of these modified references from the mUd search that correspond to false 
documents is then directly examined to determine whether it positive resute. as wM be discussed wi* reference tolFia 
matches the search criteria. After determining that docu- 6. In step 503, the code invokes a search res^t correction 
ments 322 and 323 now match the search criteria, the search routine to add references that correspond to false negative 
result correction routines add references to the documents 55 results, as will be discussed further below u conjunction 
"c:\mydoc\johndoe\doc2.txt" and with FIGS. 7 and 8, and returns. 

V\rndocManedoe\doc5jds" to the initial search result. The One skilled in the art will recognize that the search result 
code that implements the Hie Open dialog then displays the correction routines for removing false positive results and 
corrected search result in search result list box 202. for adding false negative results need not be executed in the 

One skilled in the art will recognize that the corrected 60 order shown in FIG. 5. More specifically, ui emrxxuments 
search result displayed in list box 202 can be incremenlaUy that support parallel processing or threaded processes, the 
generated and the incremental changes can be displayed as routines may be to some extent cxecutab e inparallelor as 
icy are determined. Alternatively, all of the corrections to separate threads. Also, the routines could be executed in 
the initial search result can be determined before updating reverse order. Different variations are possible depending 
the displayed list. Other similar variations arc also possible 65 upon the optimizations desired. 

in conjunction with the methods and systems of the present FIG. 6 is a flow diagram of a search result correction 
invention routine for removing false positive results. The routine 
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removes from the stared search result references to objects references to objects that have been newly added or modi- 
mat no longer exist in the collection and references to fled (the potential additions list). This step is discussed in 
objects mat were modified since they were last indexed by more detail below in conjunction with FIG. 8. In steps 
the content-index and no longer match the search criteria. In 702-710. the routine uses this potential additions list to 
step 601. the routine selects the next object reference from 5 determine which objects match the search criteria. In step 
^ S ^r^,Hn?i^ mm8 '?i me ^i^ 1 ^ U 702 ' * e selects the next reference from the potential 
^Sn^^^T^ T If preferences additions list starting with the first reference. In step *)3, the 
have beenprocessedantUf so, returns, otherwise continues roumie determines whether it has processed alltiie refer- 
?£±? P T * 6 roUt T det T DiDCS whether me ences in the list and, if so, returns.^envise continue* to 
SSL™ ? ° ^JL^ io step 704. In step 704, the routine determines whether the 
continues to step 605, otherwise continues m step 606. In selected reference is already in the stored search result and, 
step 60S, me routine removes from the stored search result if *>, returns to the beginning of the loop at step 701 because 
T^T^IT^^T^T^^T * c refere »« * a3yZcctly coLnrfin me stored 
SLSL *C2L? 5 ^ 1 f lD f search result If, however, the selected reference is not in the 
routoe detenmnes whemerfte object referred to by the 15 stored search result, then the routine continues in step 70S to 

7*™°°° „ S ^T^* SmC f "J"""-*"** the referred to object to determine wheAer the 

eoti, r that Responds to the object was last updated. If the object matches the search criteria. In step 709, if the object 

obje« has been so modrted, the rout ine continues in step miefces the search criteria, then the routtoe continues S 

607 else continues at the beginning* the loop to select the 710 . else the routine returns to the beginning of the loop to 

next reference from the stored search result ^ step 702 me aoa . maubi ^ J^* ^ 

There are many ways to determine whether a referred to added to the stored search result. In step 710, the routine 

object has been modified since the object was last indexed. adds the reference to the matching object to the stored search 

One way is to compare the timestamp stored to the object list result and returns to the beginning of the loop in step 702 

*•£ ^^^^f" *" "£* FIG. 8 is a flow diagram of a routine mat^naatei a lia 

^tT^t {?• 1^^ ^ 0Wn meCh *- 25 ° f rrfcrcnccs ««> new or modified objects. The steps in this 

k°^T 8 ^ "Z^T routi » c ^tomine what objects have been added to the 

ated wito the object For example, rfthe object is stored in coUection since the content-index was last updated and what 

, ,* ^ T^ZT ^ me objects nave been modified since their corresponding entries 

attabute property that is retrievable from the file system. A mnle content-index were last updated. In particular in step 

second way to determine whether a referred to object has 30 801, the routine sorts the references to me indexed objeSs 

been modified since the object was tost indexed, if indexed st0 red to the content-index. Similarly, to step 802, the 

objects are ref^ to dn-ecUy by die leaf structures (instead routine sorts a list of the objects contained to Mectioa 

JC f f'l* , tin f StamP StOTCd Steps 801 andM2provide greater efficiency in exe^ta 

^jf ,r *"ZV°J >le ° bjeCt . ia 2 C % i T am * reinaining steps; however, Wskilled tothe art will rccog- 

TZ^t^t^^^JT^^ 35 ni^mest sorting steps are optimizations and need Z 

£^5? 1% T^t A J md "3, to 56 exccutcd - In steps 803-808, die routine compares the 

^Z ^HuI^f , ° bjCCt ha l^ en ■»«* ^nces to indexed objects with the sorielLt of 

since *e object was last indexed, man embodiment where objects to the collection to determine the new and modified 

a smgfc timestamp is assooated with updating the entire obects. Specifically, to step 803. the routtoVsSI 

»"> cma P« I ? timestamp with the « reference tVthe next objectfrom the sorted list of objects 

^T^^° DtimeaS r?!!. edW ^ ,hCOt : jeCt ; ° nCS ™ ed ""Stained to the ccJkction starting with the first referent 

mvtvf dlSr^X^.^ 6 ^^^^ In step 804, the routine deternSwhethcr it has processed 

JS^SI SOme un P lementotlon$ ■» all of the objects to the collection and. if so. returns^ the 

more efficient than others calling routine a list of references to the new or modified 

Once lUs determined that the object has been modified. 4 s objects. Otherwise, the routine continues in step 805. In step 

instep 607, the routine examines the modified object by 805, the routine determines whether the selected object to 

performing a direct search of the contents of the object to the collection has been indexed by the content-index and, if 

determine whether the object still matches the search crite- not continues to step 806. otherwise continues to step 807. 

na. to step 608, if the routine determines that the object still In step 806, because the object is not yet indexed by the 

matches the search criteria, it leaves the reference to the 50 content-index, the routine adds a reference to the object to 

object in the stored search result and continues at the the list of references to return to the calling routine and 

beginning of the loop to step 601 to select the next reference. returns to the beginning of the loop at step 803. In step 807 

If instead the object no longer matches the search criteria, because the object is indexed, the routine determines 

the routine continues in step 609. In step 609, the reference whether the object has been modified since the correspond- 

to the object is removed from the stored search result and the 55 tog content-index entry was updated and, if so. continues to 

routine returns to the beginning of the loop at step 601. step 808, otherwise returns to the beginning of the loop in 

FIG. 7 is a flow diagram of the search result correction step 803 and ignores the already correct reference in the 

routine for adding false negative results. The routine first stored search result. As discussed earlier in conjunction with 

determines the references to objects that have been added to FIG. 6, one embodiment determines whether the object has 

the collection of objects or modified since the content-index 60 been modified since the content-index was last updated by 

was last updated. These new and modified references con- comparing the timestamp stored in the object list of the 

stitute potential additions to the search result Next, the content-index (see FIG. 2) with the last modification date 

routine determines whether the objects referred to by these associated with the object in the collection. In step 808 

potential additions match the search criteria and have not yet because the object has been modified, the object is prefer- 

been included in the stored search result and, if so, adds W ably directly searched to determine whether the object 

references to these objects to the stored search result matches the search criteria. Thus, in step 808, to enable a 

J^peaficaUy, in step 701, the routine generates a list of direct search, the routine adds a reference to the modified 
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object to the list of references to return to the calling routine to objects in the collection, which is then passed as input to 
and returns to the beginning of the loop in step 803. the object list existence determiner 1004. Also, similarly, the 

FIG 9 is a data flow diagram of a system embodiment for object list of the content-index 1010 is passed as input to an 
adding false negative results to a search result initially object list sorter 1003 to generate a sorted list of references 
generated by a content-index search engine. The ovals 5 to objects indexed by the content-index which is then passed 
shown in FIG. 9 indicate initial data supplied to the com- as input to the object list comparator 1005. The object list 
ponents of the system and the rectangles indicate the various existence determiner 1004 compares the sorted list of ref- 
components of the system. The arrows indicate data that is erences to objects contained in the stored search result with 
passed between the components of the system or data that is the sorted list of references to objects in the collection to 
initially received by a component The system comprises 10 generate two lists of references to objects. The first list is a 
seven components 901-907. As discussed earlier with ref- list of objects that are referred to in the stored search result 
erence to FIG. 1, the content-index search engine (indicated 1008 and that also exist in the collection of objects. This first 
as the content-index search code 102 in FIG. 1) initially list is passed as input to the object list comparator 100S. The 
generates and stores a search result 910 using a content- object list existence determiner 1004 also generates a second 
index This initial search result is passed as input to the 15 list of references to objects that are referred to in the stored 
object list sorter 903 to generate a sorted list of the refer- search result 1008 but that no longer exist in the collection 
ences contained in the stored search result, which is then of objects. This second list is passed as input to thesearch 
passed as input to the object reference subtracter 905. result remover 1007. The object list comparator 1005 com- 
Similarly, a list of objects in the object collection 908 is pares the list of references to objects that are part of the 
passed as input to an object list sorter 901 to generate a 20 stored search result and mat do exist with the hst of 
sorted list of references to objects in the collection, which is references to objects that are indexed by the content-index to 
then passed as input to the object list of comparator 904. generate a list of references to objects that have been 
Also,^imilarly, the object list of the content-index 909 is modified since the content-index object list 1010 was last 
passed as input to an object list sorter 902 to generate a updated. Alternatively, a list of references to objects float 
sorted list of references to the objects of the collection that 25 have been modified since the content-index object list 1010 
are indexed by the content-index, which is then passed as was last updated can be generated directly from the search 
input to the object list comparator 904. The object list result 1008 if a timestamp that malcates when the obje^w^ 
comparator 904 compares the sorted list of references to last indexed is stored in the search result 1008 when the 
objects contained in the collection with the sorted list of initial search result is generated Storing flrnestarnps in the 
references to the objects indexed by the content-index to 30 search result 1008 thus avoids the need for the object hst 
generate a list of references to objects that have not yet been sorter 1003 and the object list comparator 1005. Either way, 
indexed by the content-index and references to objects that the list of references to modified objects is then passed as 
have been modified since they were last indexed by the input to the object direct search engine 1006. TTie object 
content-index. Methods for perfomiing such a comparison direct search engine 1006 Utes as mputdata the search 
were discussed with reference to FIGS. 6 and 8. This list of 35 criteria 1011 and examines each object referred to in the hst 
references to new or modified objects is passed as input to of modified objects to determine ^whether the object still 
the object reference subtracter 905. The object reference matches the search criteria. The object direct search engine 
subtracter 905 compares the list of new or modified objects 1006 passes a list of objects that have been modified and no 
to the sorted Hst of the references contained in the stored longer match the search criteria as input to .the search result 
search result to generate a list of references to objects that 40 remover 1007. The search result remover 1007 then removes 
are new or have been modified but not yet included in the from the stored search result 1008 the references corre- 
stored search result. This list is then passed as input to the sponding to the list of objects that no longer match the 
object direct search engine 906. The object direct search search criteria. 

engine 906 also takes as input the search criteria 911 and The above discussion of embodiments of the methods and 
performs a search on each object referred to in the list of 45 systems of the present invention has assumed that the 
references to objects that are new or have been modified but collection of objects is completely indexed by the content- 
not yet included in the stored search result to determine index. One skilled in the art will realize that other embodi- 
whether the object meets the search criteria. The object ments are possible. For example, in one alternative 
direct search engine 906 then passes a list of references to emrx>diment, the collection of objects is only partially 
the objects that match the search criteria to the search result 50 indexed by the content-index. According to this 
adder 906. The search result adder 906 then adds a reference embodiment, there is a content-index inclusion rule that 
to each of these rnatching objects back into the stored search indicates whether a particular object is indexed by the 
result 910. content-index. The portion of the collection indexed is 

FIG 10 is a data flow diagram of a system ernbodiment referred to as the domain of the content-index. The methods 
for removing false positive results from a search result 53 and systems described above with reference to FIGS. 1 
initially generated by a content-index search engine. The through 10 are slightly modified to incorporate partial index- 
system comprises seven components 1001-1007. As dis- ia* In particular, the generation of the initial search result 
cussed earlier with reference to FIG. 1, the content-index using the content-index is slightly modified as well as fee 
search engine (indicated as the content-index search code search correction routines for removing false positive results 
102 in FIG. 1) initially generates and stores a search result 60 and for adding false negative results. 
1008 using a content-index. The initial stored search result Specifically, in step 501 of FIG. 5, the code that generates 
1008 is input to the object list sorter 1001 to generate a the initial search result is modified to preferably first use the 
sorted list of the references contained in the initial search content-index to efficiently generate an initial search result 
result 1008, which is then passed as input to the object list and to then directly search the remaining objects in the 
existence determiner 1004. Similarly, a list of the objects 65 collection that are not in the domain of the content-index for 
contained in the object collection 1009 is passed as input to additional objects that match the search criteria. Then, the 
object list sorter 1002 to generate a sorted list of references code adds the references generated from the direct search to 
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the initial search result Also, according to this embodiment, 
it is preferable that a flag be included with each reference in 
the stored search result to indicate whether die reference was 
placed in the stored search result as a result of a direct search 
of die object as opposed to as a result of a search using die 5 
content-index. This flag is used far optimization purposes to 
avoid unnecessary searching of the object in the search 
result correction routines. One skilled in the art will recog- 
nize that the inclusion of such a flag is not necessary and mat 
other implementations of preserving such information are 
possible. 

FIG. 11 is a partial flow diagram of the modifications to 
the search correction routine for removing false positive 
results when using partial content-indexing. Anew step 1103 
is added between steps 602 and 604 in FIG. 6 to avoid a 
direct search of those objects referred to in the stored search 15 
result that have already been examined. Specifically, in step 
1103, if the flag for the selected reference in the stored 
search result Indicates that the reference was added to the 
stored search result as a result of a direct search of the object, 
then the routine returns to step 601 to select the next object 20 
reference from the stored search result Otherwise, the 
routine continues in step 604 to determine whether the 
object referred to by the selected reference exists in the 
collection of objects. 

FIG. 12 is a partial flow diagram of the modifications to 25 
the search result correction routine for adding false negative 
results when using partial indexing. The modifications to 
this routine involve determining whether any of die refer- 
ences to new or modified objects (potential additions) are 
not part of the domain of the content-index to efficiently 30 
determine whether the object matches the search criteria. 
Specifically, a test is added between step 704 and step 708 
of FIG. 7 to determine whether the object referred to by the 
selected reference is in the domain of the content-index. This 
determination is performed using the content-index indu- 33 
si on rule. This test is placed after checking for references 
that are already included in the stored search result in order 
to conclude that if the object is not included in the domain 
then by definition it does not match the search criteria 
because the loop would already have been exited by first 40 
detecting that the object was referred to in the stored search 
result. 

As shown in FIG. 12, multiple steps have been added to 
the routine of FIG. 7. These steps accommodate another 
alternative embodiment that uses multiple content-indices to 4s 
index a particular collection of objects. At this point, let it 
suffice in FIG. 12 to note that multiple content-indices can 
be used in conjunction with the embodiment of partial 
indexing such that each content-index is checked as needed 
to determine whether the new or modified object is included 50 
in the domain of at least one content-index. Once the routine 
determines that the new or modified object is included in the 
domain of at least one content-index, then in step 1208 the 
referred to object is examined to determine whether it 
matches the search criteria. 35 

Similar to a partially indexed collection, in the alternative 
embodiment that employs multiple content-indices to index 
a collection of objects, each content-index has a correspond- 
ing content-index inclusion rule for determining whether a 
particular object is in the domain of that content-index. 
According to this embodiment several modifications are 
made to the code for generating the initial search result and 
to the routines for removing false positive results and for 
adding false negative results to accommodate multiple 
content-indices. In particular, step 501 of FIG. 5 is modified 
to generate the initial search result using all of the content- 
indices for that particular collection of objects. 
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Similarly, step 606 of FIG. 6, which determines whether 
a referred to object has been modified since the content- 
index was last updated, preferably checks all of the content- 
indices to determine whether the object is modified. One 
would appreciate that several methods for performing these 
checks are possible. For example, if the domains of the 
content-indices are mutually exclusive, then as soon as the 
object is found in one of the content-indices and the appro- 
priate timestamp retrieved, then the remainder of the 
content-indices need not be examined. Also, the content- 
index inclusion rules for each of the content-indices could be 
examined until the appropriate content-index is found. Then, 
the ar^ropriate content-index is searched. 

As briefly discussed in conjunction with partial indexing, 
the search correction routine for adding false negative 
results is also modified. In particular, as shown in step 1205 
of FIG. 12, the next content-index inclusion rule is selected. 
Then in step 1206, if all of the content-index inclusion rules 
have been processed, the routine returns to the beginning of 
the loop at step 702 of FIG. 7 (shown as step 1202). If, on 
the other hand, there are more inclusion rules to process, 
then the routine continues in step 1207. If the selected 
inclusion rule indicates that the object referred to by the 
selected reference is to be included in the domain of the 
content-index governed by the selected inclusion rule, then 
the routine continues at step 1208 to examine the referred to 
object to determine whether it matches the search criteria. 
Otherwise, if the selected inclusion rule indicates that the 
referred to object is not included in the domain of the 
content-index governed by the selected inclusion rule, then 
the routine continues in step 1205 to select the next content- 
index inclusion rule. This process continues until either one 
of the inclusion rules indicates that the reference to the new 
or modified object is in the domain of one of the content- 
indices or until all of the inclusion rules have been pro- 
cessed. If the referred to object is not included in the domain 
of any content-index, then the object has already been 
examined during the initial search result generation and 
determined not to match the search criteria. One skilled in 
the art would appreciate that several variations in the logic 
are possible depending upon whether the content-indices are 
mutually exclusive and whether partial indexing is allowed. 

In addition to the changes to FIG. 7 that are shown in FIG. 
12, the generation of the list of new or modified objects 
(FIG. 8) is preferably modified to compare the references of 
all the content-indices with the list of objects currently 
included in the collection (see steps 801 and 805-807 in 
FIG. 8). It is also preferred that the content-indices sorted in 
step 801 are sorted together to optimize the comparisons 
performed in steps 805 and 807. 

In yet another embodiment die methods and systems of 
the present invention take into account that not all possible 
searches can be solved using a content-index. The searches 
that can be solved using a content-index depend upon the 
information stored in the content-index. For example, a 
search that involves searching for a particular occurrence of 
a term in a document is typically not solved using a 
content-index unless occurrence information is also stored in 
the content-index. The "Advanced Search** button 205 in 
FIG. 2, for example, could be used to specify such a search 
criteria 

For example, a content-index such as that described in 
conjunction with FIG. 3 could store occurrence information 
for each reference to a document that contains the indexing 
term More specifically, in one embodiment each reference 
In each leaf structure 309-312 points to a tuple comprising 
(reference to document occurrence,, . . . occurrence^ where 
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the "reference to document" is the same as that shown in searching the content-index to identify objects that satis- 

FIG. 3 (eg., "1") and each occurrence, is an occurrence fied the search criteria before the collection of objects 

indicator (e.g.. a number), which indicates the location of the was updated, and storing an indication of each idcuti- 

indexing term within the document An occurrence number fied object as the search result; and 

could indicate, for example, that the indexing term is the V s 5 updating the search result to reflect the updated collection 

word in the document For example, the tuples ( 1, 3, 16) and of objects by, 

(3, 5) substituted for leaf structure 309 indicate that the adding an indication of each object that was added to 

indexing term "A" is found in document "1** as the 3"* word the collection of objects and that satisfies the search 

and the 16* word and in document "3" as the 5* word. criteria; 

Alternatively, if the content-index does not store occur- *° removing the indication of each object that was 
rence information, then a search for a particular location or removed from the collection of objects; 
the i* occurrence of a term in a document is not solvable adding an indication of each object that was modified 
exclusively using that content-index. In this case, the meth- and that now satisfies the search criteria; and 
ods and systems of the present invention are modified to removing the indication to each object that was modi- 
incorporate more complex searches. 15 fied and that no longer satisfies the search criteria. 

HG. 13 is a flow diagram of the modifications to the . The me^ofclaim I wherein the step erf removing an 

contents search cadeof FIG. 5 when used with a search mdicaUon of each object that was re ^ r ^* e ^ 

criteria that goes beyond a search solved exclusively using *f » deternimed by examining an object list of the object 

a content-ind^ Specifically, in step 1301, the search criteria referred to in the ^nt-index to determine whedier each 

I totted into a cSt-index portion, wk* is the portion 20 object referred to by the object list exists in the collection of 

of me search that canbe P^^^ o ^^ ° b £¥ne method of claim 1, the content-index having a 

and a direct search portion, which is the portion of the search . * ujw^ms* « * 

that requires searchhig the object directly to determine ^estamp for each object referred to by die content-index, 

whethe/the content of me object matches the search criteria. ^ each timestamp recording a hm^en the corresponding 

According to this embodiment the logical operator that 25 object was last 

joins the Ltent-index portion of the search crteria and the an indication to each object that was modified and that no 

Search portion iTpreferably a conjunction (e.g., a longer satisfies the search criteria comprises the substeps of: 

logical AND). That so, the portion of the search that is not for each object referred to in the search result, retrieving 

solved using the content-index (the direct search portion) a time the object was last modified; 

further restricts the results of the search generated using the 30 detennining whether the time recorded by the timestamp 

content-index portion. In step 1302, the routine generates a in the content-index for the object is different from the 

proposed search result using the content-index portion of the retrieved time; 

search criteria. In step 1303, the routine directly searches when it is determined that the time recorded by the 
each object referred to by the references in the proposed timestamp is different from the retrieved time, search- 
search result for a match using the direct search portion of 35 ing the object to determine whether the object still 
the search criteria. In step 1303, the routine then removes satisfies the search criteria; and 
from the proposed search result the references to objects that when it is determined that the searched object no longer 
do not match the direct search portion. Because the objects satisfies the search criteria, removing the indication of 
in the remaining search result presumably match the search the object from the search result 
criteria, no false positives preferably remain in the search 4. The method of claim 1 wherein the step of adding an 
result Thus, the search correction routine for removing false indication of each object that was added to the collection of 
positive results need not be invoked. However, the search objects and that satisfies the search criteria further comprises 
correction routine for adding false negative results is the substeps of: 
invoked in step 1304, and then the routine returns. 

jc comparing the objects currently in the collection with 

Although the present invention has been disclosed and those objects referred to in the content-index to deter- 

described in terms of preferred embodiments, it is not mine a set of new objects; 

intended that the invention be limited to such embodiments. searching each new object to determine whether each new 

Modifications within the spirit of the invention will be object satisfies the search criteria; and 

apparent to those skilled in the art The scope of the present ^ wnen a searched new object satisfies the search criteria, 

invention is defined by the claims which follow. adding an indication of the new object to the search 

We claim: result 

1. A method in a computer system for generating a search 5 The method of claim 1, the content-index having a 
result that identifies objects that satisfy a search criteria, the timestamp for each object referred to by the content-index, 
computer system having a collection of objects and a 55 timestamp recording a time when the corresponding 
plurality of terms, each object containing one or more of the object was last modified, and wherein the step adding an 
terms, the method comprising the computer-implemented indication of each object that was modified and that now 
steps of: satisfies the search criteria comprises the substeps of: 
creating a content-index that contains, for each of the for each object referred to in the content-index, 
plurality of terms, a reference to each object that retrieving a time the object was last modified; 
contains the term; determining whether the time recorded by the tunes- 
after creating the content-index, updating the collection of tamp in the content-index for the object is different 
objects by adding new objects to the collection, by from the retrieved time; 

removing objects from the collection, or by modifying when it is determined that the time recorded by the 

the terms contained by an object the updating being 65 timestamp is different from the retrieved time, 

performed without updating the content-index to reflect searching the object to determine whether the object 

the updates to the collection of objects; satisfies the search criteria; and 
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when it is determined that the searched object satisfies 
the search criteria, adding an indication of the object 
to the search result 

6. The method of claim 1 wherein the collection of objects 
comprises a corpus of documents. 5 

7. A method in a computer system for correcting a search 
result obtained by searching a content-index to identify 
objects that match a search criteria, the objects contained in 
a collection of objects, the content-index containing, for 
each of a plurality of terms, a reference to an object in the 
collection that contains the term, the method comprising the 
computer-implemented steps of: 

determining a current state of the collection of objects; 
and 

when it is determined that the search result obtained by 
searching the content-index is out of date relative to the 15 
current state of the collection of objects, correcting the 
search result to reflect updates to the collection of 
objects since the content-index was last updated with- 
out first updating the content-index. 

8. The method of claim 7 wherein the step of correcting 20 
the search result to reflect updates to the collection removes 
from the search result indications of objects mat, as a result 

of updating of the collection, no longer match the search 
criteria and adds to the search result indications of objects 
that, as a result of updating of the collection, now match the 25 
search criteria. 

9. The method of claim 7 wherein the step of correcting 
the search result to reflect updates to the collection removes 
indications of objects that no longer exist in the collection 
and removes indications of objects that have been modified 30 
and no longer match the search criteria. 

10. The method of claim 7 wherein the step of correcting 
the search result to reflect updates to the collection adds 
indications to objects that have been added to the collection 
and match the search criteria and adds indications to objects 35 
that have been modified and now match the search criteria. 

11. A method in a computer system for updating a search 
result obtained by searching a content-index to identify 
objects that match a search criteria, the objects contained in 

a collection of objects, the content-index partially indexing 40 
the collection of objects and containing, for each of a 
plurality of terms, a reference to an object in the collection 
that contains the term, the method comprising the computer- 
implemented steps of: 
displaying the search result obtained by searching the 45 

content-index; 
after displaying the search result obtained by searching 
the content-index, determining the objects in the col- 
lection that are not indexed by the content-index and ^ 
that match the search criteria; 
updating the search result to include indications of the 

determined objects; and 
displaying the updated search result. 
11 A method in a computer system for correcting a search 55 
result obtained by searching a content-index to identify 
objects that match a search criteria, the objects contained in 
a collection of objects, the content-index containing, for 
each of a plurality of terms, a reference to an object in the 
collection that contains the term, the method comprising the 50 
computer-implemented steps of: 
updating the collection of objects, after the content-index 
was last updated causing the search result to be out of 
date; 

removing, from the out of date search result, indications &s 
of objects that, as a result of updating of the collection, 
no longer match the search criteria; and 
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adding, to the out of date search result, indications of 
objects that as a result of updating of the collection, 
now match the search criteria. 

13. The method of claim 12 wherein the step of removing 
indications of objects that as a result of updating of the 
collection, no longer match the search criteria removes 
indications of objects that no longer exist in the collection of 
objects. 

14. The method of claim 12 wherein the step of removing 
indications of objects that as a result of updating of the 
collection, no longer match the search criteria removes 
indications of objects that have been modified and no longer 
match the search criteria. 

15. The method of claim 12 wherein the step of adding 
indications of objects that as a result of updating of the 
collection, now match the search criteria adds indications of 
objects that have been added to the collection and match the 
search criteria. 

16. The method of claim 12 wherein the step of adding 
indications of objects that, as a result of updating of the 
collection, now match the search criteria adds indications of 
objects that have been modified and now match the search 
criteria. 

17. The method of claim 12 wherein the objects in the 
collection are documents. 

18. A method in a computer system for correcting a search 
result that identifies objects that match a search criteria, the 
objects contained in a collection of objects, the search result 
generated from a content-index, the content-index 
containing, for each of a plurality of terms, a reference to an 
object in the collection that contains the term, wherein the 
collection is only partially indexed by the content-index, the 
method comprising the cornputer-implemented steps of: 

updating the collection of objects causing the search result 
to be out of date; 

removing, from the search result indications of objects 
that as a result of updating of the collection, no longer 
match the search criteria; and 

adding, to the search result, indications of objects that as 
a result of updating of the collection, now match the 
search criteria, wherein the search result also indicates 
objects that are in the collection, match the search 
criteria, but are not indexed by the content-index. 

19. The method of claim 18 wherein the collection is 
indexed by a plurality of content indices and wherein the 
steps of removing indications of objects that no longer 
match the search criteria and adding indications of objects 
that now match the search criteria are determined by exam- 
ining the plurality of content indices. 

20. The method of claim 12 wherein the collection is 
indexed by a plurality of content indices and wherein the 
steps of removing indications of objects that no longer 
match the search criteria and adding indications of objects 
that now match the search criteria are determined by exam- 
ining the plurality of content indices. 

21. A method in a computer system for correcting a search 
result obtained by searching a content-index to identify 
objects that satisfy a search criteria, the objects contained in 
a collection of objects, the content-index containing, for 
each of a plurality of terms, a reference to an object in the 
collection that contains the term, the method comprising the 
computer-implemented steps of: 

updating the collection of objects, after the content-index 
was last updated, causing the search result to be out of 
date; 

removing, from the out of date search result indications 
of objects that as a result of updating the collection, no 
longer exist in the collection of objects; and 



03/31/2004, EAST 



version: 1.4.1 



5,701,469 

19 20 

removing, from the out of date search result, indications 30. A method in a computer system for correcting a stored 

of objects that, as a result of updating the collection, no search result obtained by searching a content-index to iden- 

longer satisfy the search criteria. tify objects that satisfy a search criteria, the objects con- 

22. The method of claim 21, the content-index having a tained in a collection of objects, the content-index 
timestamp for each object referred to by the content-index, 5 containing, for each of a plurality of terms, a reference to an 
each timestamp indicating a time when the corresponding object in the collection that contains the term, the method 
object was last modified, wherein the step of removing, from comprising the computer-implemented steps of: 

the out of date search result, indications of objects that no updating the collection of objects, after the content-index 

longer satisfy the search criteria comprises the sub-steps of: was ^ updated, causing the search result to be out of 

examining each object, that is indicated by the search 10 ^ 

result and has been mocked since die time mooted by ' to the out of date search result, indications of 

the timestamp for the object, to determine whether the aaaing, » mc out 01 ojuc w ™ _ , 

~r. "rL^rllri^o. tu- ^it^no. nn H objects that are new to the collection as a result of 

object still satisfies fce search cnto^^nd J££ the collection and satisfy the search criteria; 

when it is determined that an examined object no longer upoaung mc wuw»«n ai« «u*« j 

satisfies the search criteria, removing the indication to ^ . . 

the object from the search result adding, to the out of date search result, indications of 

23. The method of claim 21, further comprising the step objects that have been modified as a result of updating 
of adding, to the out of date search result, indications of the collection and now satisfy the search criteria, 
objects that have been added to the collection as a result of 31, The method of claim 30 wherein the plurality of 
updating the collection and satisfy the search criteria. objects is a plurality of documents. 

24. The method of claim 21, the content-index having a 20 3^ jh e method of claim 30, further comprising the step 
timestamp for each object referred toby the content-index, 0 f removing, from the out of date search result, references to 
each timestamp indicating a time when the corresponding objects that no longer exist in the collection of objects, 
object was last modified, further comprising the steps of: 33, The method of claim 30, further comprising the step 

examining each object that is referred to by the content- of removing, from the out of date search result, references to 

index and has been modified since the time indicated by 25 objects that no longer match the search criteria as a result of 

the timestamp for the object, to determine whether the updating the collection. 

object satisfies the search criteria; and 34 jh e method of rUim 30, the collection of objects only 

when it is determined that an examined object satisfies the partially indexed by the content-index, the collection having 

search criteria, adding to the out of date search result an ^ ^ to determine whether an object in the 

indication of the object } ^ 30 ^^on ^ indexed by the content-index, the search result 

25. The method of claim 21 wherein the objects in the mduding indications of objects mat satisfy the search 
collection are documents. criteria, are in the collection, but not indexed by the content- 

26. The method of claim 21, the coUection of objects only + f ^ references to objects 

partially indexed by ^^^in L^^lt ^ ^LlT^ccZaon of objects and satisfy the 

including indicauons of objects mat are in the collection 01 33 . co<: fK _ JL„ nf . 

objeTbut not indexed fay the content-index, and further search criteria farther comprises the steps of. 

comprising the steps of: for each object that is new to the collection as a result of 

for each indication of each object in the search result, updating, 

first determining whether the object indicated by the determining whether the object is referred to by the search 

indication is not indexed by the content-index; and ^ result; 

when the object is not indexed by the content-index, wnen the object is not referred to by the search result 

skipping the indication so mat the indication remains deterniining whether the indexing rule indicates that the 

in the search result object is to be indexed by the content-index; and 

27. The method of claim 26 wherein the step of deter- when mc indexing rule indicates that the object is to be 
inining whether the object indicated by the indication is not content-index, examining the object to 

o&^HS % C ^^^nV^^ method of claim 30 wherein the coUection of 

wheSL *e S of r^vCuXtions of objects mat no objects ^ indexed by a plurality of content u£<x* ; and 

longer satisfythe search criteria examines each object that 50 wherein the step of adding indications fj^** ^ 

hasten modified since the object was indexed by one of the new to the coUection and indications of objects that have 

content indices. been modified is performed by examining each of the 

29. The method of claim 21 wherein the coUection of plurality of content indices, 

objects is indexed by a plurality of content indices, the 36. The method of claim 30 wherein the coUection of 

content indices only partiaUy indexing the objects in the 55 objects is indexed by a pluraUty of content indices, the 

coUection, the search result including indications of objects coUection having an indexing rule for each content-index to 

that satisfy the search criteria and are in the coUection of determine whether an object in the coUection is indexed by 

objects but not indexed by the plurality of content indices, the content-index, the search result including indications of 

and further comprising the steps of: objects that satisfy the search criteria, are in the coUection, 

for each indication in the search result 60 but not indexed by the content-index, and wherein the step 

for each content-index, first determining whether the of adding indications of objects that are new to the collection 

indication indicates an object that is indexed by the and satisfy the search criteria further comprises the steps of: 

content-index; and for each object mat is new to the coUection, 

when the indication indicates an object not indexed by deterniimng whether the object is referred to by the 

any of the pluraUty of content indices, skipping the 65 search result; 

indication so that the indication remains in the search when the object is not referred to by the search result 

result detennining, for each content-index, whether the 
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indexing rule of the content-index indicates that the 
object is to be indexed by the content-index; and 
when the indexing rule for one of the content indices 
indicates that the object is to be indexed, examining 
the object to determine whether the object satisfies 
the search criteria. 
57. A method in a computer system for updating a search 
result that identifies objects that satisfy a search criteria, the 
objects contained in a collection of objects, the search 
criteria having a content-index search portion used with a 
content-index to determine a set of objects of the collection 
that satisfy the content-index search portion, the search 
criteria having a direct search portion, the direct search 
portion further restricting the set of objects that satisfy the 
content-index search portion in order to satisfy the search 
criteria, the method comprising the computer-implemented 
steps of: 

generating a proposed list of references to objects that 

satisfy the content-index portion of the search criteria 

by searching the content-index; 
examining each object in the proposed list of references to 

determine whether the object also satisfies the direct 

search portion; 

storing in the search result an indication of each examined 
object that satisfies the direct search portion in the 
search result; 

modifying the collection of objects causing the search 

result to be out of date; and 
updating the search result by adding, to the search result, 

indications of objects that, as a result of modifying the 

collection, match the search criteria. 
38. The method of claim 37 wherein the indications to be 
added are indications of objects that were added as a result 
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documents, the method comprising the computer- 
implemented steps of: 
generating the search result by searching a content-index 
for a set of documents of the corpus that match a search 
criteria and by storing in the search result an indication 
of each document that matches the search criteria, the 
content-index containing for each of a plurality of 
terms, a reference to a document associated with the 
term, wherein the corpus is only partially indexed by 
the content-index such that die generated search result 
stores indications to documents that are in the corpus, 
match the search criteria, but are not indexed by the 
content-index; 

removing, from the search result, indications of docu- 
ments that no longer exist in the corpus; 

removing, from the search result, indications of docu- 
ments that no longer match the search criteria; 

adding, to the search result, indications of documents that 
are new to the corpus since the content-index was last 
updated and match the search criteria; and 

adding, to the search result, indications of each document 
that has been modified since the document was last 
indexed by the content-index and now matches the 
search criteria. 

42. The method of claim 41 wherein the corpus is indexed 
by a plurality of content indices. 

43. The method of claim 42 wherein the step of removing 
indications of documents that no longer match the search 
criteria uses the plurality of content indices to determine 
whether a document has been modified. 

44. The method of claim 40 wherein the corpus is indexed 
by a plurality of content indices. 

45. A computer system for adding false negative results to 
a search result store, the search result store having references 



of modifying the collection and match the search criteria and 35 ^ ? coUcction of o**** 5 that **** * search 



indications of objects that were modified as a result of 
modifying the collection and now match the search criteria. 

39. The method of claim 37 wherein the collection of 
objects is a plurality of documents. 

40. A method in a computer system for correcting a search 40 
result, the computer system containing a corpus of 
documents, the method comprising the computer- 
implemented steps of: 

generating the search result by searching a content-index 
for a set of documents of the corpus that match a search 
criteria and by storing in the search result an indication 
of each document that matches the search criteria, the 
content-index containing for each of a plurality of 
terms, a reference to a document associated with the 
term; 

removing, from the generated search result, indications of 
documents that no longer exist in the corpus; 

removing, from the generated search result indications of 
documents that no longer match the search criteria; 

adding, to the generated search result, indications of 
documents that are new to the corpus since the content- 
index was last updated and match the search criteria; 
and 

adding, to the search result, indications of each document 
that has been modified since the document was last 
indexed by the content-index and now matches the 
search criteria, wherein the steps of removing from and 
adding to the generated search result are performed 
without first updating the content-index. 

41. A method in a computer system for correcting a search 
result, the computer system containing a corpus of 
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criteria, comprising: 
an search result adder that, in response to receiving a 
additions list of references to objects, adds each refer- 
ence in the additions list to the result store; 
an object direct search engine that, in response to receiv- 
ing a search list of references to objects to be searched, 
searches each object referred to by the search list to 
determine whether the object matches the search cri- 
teria and passes a list of references to the searched 
objects that match the search criteria to the search result 
adder as the additions list; 
an object reference subtracter that in response to receiv- 
ing a first list of references to objects and a second list 
of references to objects, compares each list, generates 
a revised potential additions list that includes refer- 
ences to objects that are referred to in the first list but 
not in the second list, and passes the revised potential 
additions list to the object direct search engine; 
an object list comparator that, in response to receiving a 
third list of references to objects and a fourth list of 
references to objects, compares the third list with the 
fourth list and generates a potential additions list that 
includes references to objects that are referred to in the 
third list but mat are not referred to in the fourth list and 
that includes references to objects that are referred to in 
both the third and fourth lists but have been modified 
since a timestamp associated with the reference to the 
object in the fourth list, and passes the generated 
potential additions list to the object reference subtracter 
as the first list; 
a search result list sorter that, in response to receiving a 
list of references to objects referred to by the search 
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result store, generates a sorted list of references to 
objects referred to by the search result store, and passes 
the sorted list of references to objects referred to by the 
search result store to the object reference subtracter as 
the second list; 
a collection object list sorter that, in response to receiving 
a list of references to the objects in the collection, 
generates a sorted list of references to objects in the 
collection and passes the sorted list of references to 
objects in the collection to the object list comparator as 
the third list; 

a content-index object list sorter mat, in response to 
receiving a list of references to objects indexed by the 
content-index, generates a sorted list of references to 
indexed objects and passes the sorted list of references 
to indexed objects to the object list comparator as the 
fourth list; and 

an invocation mechanism that sends the list of references 
referred to by the search result store to the search result 
list sorter, sends the list of references to the objects in 
the collection to the collection object list sort, and sends 
the list of references to objects indexed by the content- 
index to the content-index object list sorter. 

46. The computer system of claim 45, each generated list 
having elements, and wherein the object reference 
subtracter, the object direct search engine, and the search 
result adder work together in a pipelined architecture pro- 
cessing an element at a time as each element is received. 

47. A computer system for removing false positive results 
from a search result store, the search result store having 
references to objects from a collection of objects that match 
a search criteria, comprising: 

an search result subtracter that, in response to receiving a 
subtractions list of references to objects, removes each 
reference in the subtractions list from the result store; 

an object direct search engine that, in response to receiv- 
ing a search list of references to objects to be searched, 
searches each object referred to by the search list to 
determine whether the object matches the search cri- 
teria and passes a list of references to the searched 
objects that do not match the search criteria to the 
search result remover as the subtractions list; 

an object list comparator that in response to receiving a 
first list of references to objects and a second list of 45 
references to objects, compares each list, generates a 
revised potential subtractions list that includes refer- 
ences to objects are referred to by both the first and 
second lists and have been modified since a timestamp 
associated with the reference to the object in the second 
list and passes the potential subtractions list to the 
object direct search engine as the search list; 

an object list existence determiner that, in response to 
receiving a third list of references to objects and a 
fourth list of references to objects, compares the third 
list and the fourth list, generates an existing objects list 
that includes references to objects that are referred to in 
both the third list and in the fourth list generates a 
non-existing objects list that includes references to 
objects that are referred to in the third list but not in the 
fourth list passes the generated existing objects list to 
the object list comparator as the first list and passes the 
generated non-existing objects list to the search result 
remover as the subtractions list; 

a search result list sorter that in response to receiving a 
list of references to objects referred to by the search 
result store, generates a sorted list of references to 
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objects referred to by the search result store, and passes 
the sorted list of references to objects referred to by the 
search result store to the object list existence deter- 
miner as the third list; 

a collection object list sorter that in response to receiving 
a list of references to the objects in the collection, 
generates a sorted list of references to objects in the 
collection and passes the sorted list of references to 
objects in the collection to the object list existence 
determiner as the fourth list 

a content-index object list sorter that in response to 
receiving a list of references to objects indexed by the 
content-index, generates a sorted list of references to 
indexed objects and passes the sorted list of references 
to indexed objects to the object list comparator as the 
second list and 

an invocation mechanism that sends the list of references 
referred to by the search result store to the search result 
list sorter, sends the list of references referred to by the 
search result store and to the search result remover, 
sends the list of references to the objects in the collec- 
tion to the collection object list sorter, and sends the list 
of references to objects indexed by the content-index to 
the content-index object list sorter. 

48. The computer system of claim 47, each generated list 
having elements, and wherein the object list comparator, the 
object direct search engine, and the search result remover 
work together in a pipelined architecture processing an 
element at a time as each element is received. 

49. A computer system for removing false positive results 
from a search result stare and for adding false negative 
results to the search result store, the search result store 
generated by searching a content-index for objects from a 
collection of objects that match a search criteria, the search 
result store having references to the matching objects, com- 
prising: 

means for removing, from the search result stare, refer- 
ences to objects mat no longer exist in the collection; 

means for removing, from the search result store, refer- 
ences to objects that no longer match the search crite- 
ria; 

means for adding, to the search result store, references to 
objects that are new to the collection and match the 
search criteria; and 
means for adding, to the search result store, references to 
each object that has been modified since the object was 
indexed and that matches the search criteria, 
the means for removing and the means for adding operating 
without first updating the content-index. 

50. A computer-readable memory medium containing 
instructions for controlling a computer processor in a com- 
puter system to correct a search result obtained by searching 
a content-index to identify objects that match a search 
criteria, the objects contained in a collection of objects, the 
content-index containing, for each of a plurality of terms, a 
reference to an object in the collection that contains the term, 
by performing the steps of: 

determining a current state of the collection of objects; 
and 

when it is determined that the search result obtained by 
searching the content-index is out of date relative to the 
current state of the collection of objects, correcting the 
search result to reflect updates to the collection of 
objects since the content-index was last updated, with- 
out first updating the content-index. 

51. The computer-readable memory medium of claim 59 
wherein the step of correcting the search result to reflect 
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updates to the collection removes from the search result 
indications of objects that, as a result of updating of the 
collection, no longer match the search criteria and adds to 
the search result indications of objects that, as a result of 
updating of the collection, now match the search criteria. 5 

52. The computer-readable memory medium of claim 50 
wherein the step of correcting the search result to reflect 
updates to the collection removes indications of objects that 
no longer exist in the collection and removes indications of 
objects that have been modified and no longer match the ]Q 
search criteria. 

53. The computer-readable memory medium of claim 50 
wherein the step of correcting the search result to reflect 
updates to the collection adds indications to objects that 
have been added to the collection and match the search 
criteria and adds indications to objects mat have been 15 
modified and now match the search criteria. 

54. A method in a computer system for coirecting a search 
result mat identifies objects that satisfy a search criteria, the 
objects contained in a collection of objects, the search result 
generated using a content-index, the content-index 20 
containing, for each of a plurality of terms, a reference to an 
object in the collection mat contains the term, the content- 
index having a time stamp for each object referred to by the 
content-index, each timestamp indicating a time when the 
corresponding object was last modified, the method com- 25 
prising the computer-implemented steps of: 

updating the collection of objects causing the search result 

to be out of date; 
removing, from the search result, indications of objects 

that, as a result of updating the collection, no longer ^ 

exist in the collection of objects; and 
removing, from the search result, indications of objects 

that, as a result of updating the collection, no longer 

satisfy the search criteria by: 

examining each object mat is indicated by the search J5 
result and has been modified since the time indicated 
by the timestamp for the object, to determine 
whether the object still satisfies the search criteria; 
and 

when it is determined that an examined object no ^ 
longer satisfies the search criteria, removing the 
indication to the object from the search result 

55. A method in a computer system for correcting a search 
result that identifies objects that satisfy a search criteria, the 
objects contained in a collection of objects, the search result ^ 
generated using a content-index, the content-index 
containing, for each of a plurality of terms, a reference to an 
object in the collection that contains the term, the content- 
index having a timestamp for each object referred to by the 
content-index, each timestamp indicating a time when the M 
corresponding object was last modified, the method com- 
prising the steps of: 

updating the collection of objects causing the search result 
to be out of date; 

removing, from the search result indications of objects 53 
that, as a result of updating the collection, no longer 
exist in the collection of objects; 

removing, from the search result indications of objects 
that as a result of updating the collection, no longer 
satisfy the search criteria; ^ 

examining each object that is referred to by the content- 
index and has been modified since the time indicated by 
the timestamp for the object to determine whether the 
object satisfies the search criteria; and 

when it is determined that an examined object satisfies the 63 
search criteria, adding to the search result an indication 
of the object. 



56. A method in a computer system for correcting a search 
result that identifies objects that satisfy a search criteria, the 
objects contained in a collection of objects, the search result 
generated using a content-index, the content-index 
containing, for each of a plurality of terms, a reference to an 
object in the collection that contains the term, the collection 
of objects only partially indexed by the content-index, the 
search result including indications of objects that are in Che 
collection of objects but not indexed by the content-index, 
the method comprising the steps of: 

updating the collection of objects causing the search result 

to be out of date; 
for each indication of each object in the search result 
first determining whether the object indicated by the 

indication is not indexed by the content-index; and 

when the object is not indexed by the content-index, 
skipping the indication so that the indication remains 
in the search result; 
removing, from the search result indications of objects 

that as a result of updating the collection, no longer 

exist in the collection of objects; and 
removing, from the search result indications of objects 

that as a result of updating the collection, no longer 

satisfy the search criteria. 

57. The method of claim 56 wherein the step of deter- 
mining whether the object indicated by the indication is not 
indexed by the content-index is performed by examining a 
flag stored with indication in the search result 

58. A method in a computer system for correcting a search 
result that identifies objects that satisfy a search criteria, the 
objects contained in a collection of objects that is indexed by 
a plurality of content indices, the content indices only 
partially indexing the objects in the collection, each 
contents-index containing, for each of a plurality of terms, a 
reference to an object in the collection that contains the term, 
the search result generated using a content-index and includ- 
ing indications of objects that satisfy the search criteria and 
are in the collection of objects but not indexed by the 
plurality of content indices, the method comprising the steps 
of: 

updating the collection of objects causing the search result 

to be out of date; 
for each indication in the search result 
for each content-index, first determining whether the 

indication indicates an object that is indexed by the 

content-index; and 
when the indication indicates an object not indexed by 

any of the plurality of content indices, skipping the 

indication so that the indication remains in the search 

result; 

removing, from the search result indications of objects 

that as a result of updating the collection, no longer 

exist in the collection of objects; and 
removing, from the search result indications of objects 

that as a result of updating the collection, no longer 

satisfy the search criteria. 

59. A method in a computer system for correcting a stored 
search result that identifies objects that satisfy a search 
criteria, the search result generated using a content-index, 
the objects contained in a collection of objects that are only 
partially indexed by the content-index, the collection having 
an indexing rule to deterrnine whether an object in the 
collection is indexed by the content-index, the content-index 
containing, for each of a plurality of terms, a reference to an 
object in the collection that contains the term, the search 
result including indications of objects that satisfy the search 
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criteria, arc in the collection, but not indexed by the content- 
index, the method comprising the computer-implemented 
steps of: 

updating the collection of objects causing the search result 
to be out of date; 

adding, to the search result, indications of objects that are 
new to the collection as a result of updating the 
collection and satisfy the search criteria by: 
for each object mat is new to the collection as a result 
of updating. 

determining whether the object is referred to by the 
search result; 

when the object is not referred to by the search result 
determining whether the indexing rule indicates that 
the object is to be indexed by the content-index; and 

when the indexing rule indicates that the object is to be 
indexed by the content-index, examining the object 
to determine whether the object satisfies the search 
criteria; and 

adding, to the search result indications of objects that 
have been modified as a result of updating the collec- 
tion and now satisfy the search criteria. 
60. A method in a computer system for correcting a stored 
search result that identifies objects that satisfy a search 
criteria, the search result generated using a content-index, 
the objects contained in a collection of objects that is 
indexed by a plurality of content indices, the collection 
having an indexing rule for each content-index to determine 
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whether an object in the collection is indexed by the content- 
index, each content-index containing, for each of a plurality 
of terms, a reference to an object in the collection that 
contains the term, the search result including indications of 
objects that satisfy the search criteria, are in the collection, 
but not indexed by the content-indices, the method com- 
prising the coinputer-implemented steps of: 
updating the collection of objects causing the search result 

to be out of date; 
adding, to the search result, indications of objects that are 
new to the collection as a result of updating the 
collection and satisfy the search criteria by: 
for each object that is new to the collection, 
determining whether the object is referred to by the 
search result; 

when the object is not referred to by the search result 
determining, for each content-index, whether the 
indexing rule of the content-index indicates that the 
object is to be indexed by the content-index; and 
when the indexing rule for one of the content indices 
indicates that the object is to be indexed, examining 
the object to determine whether the object satisfies 
the search criteria; and 
adding, to the search result indications of objects that 
have been modified as a result of updating the collec- 
tion and now satisfy the search criteria. 
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